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@ Method and apparatus for combining encoding and modulation. 

@ A method and apparatus for combining encoding and 
modulation creates signal sets from available amplitude and 
phase modulations by Indexing ordered subspaces. The 
subspaces need not be limited to the class of subspaces 
known as binary subspaces. The resultant signal sets, for a 
preselected power and bandwidth, are widely separated and 
unlikely to be confused by the effects of channel noise. Such 
signals can be In either finite block or convolutional form, 
depending on the natural format of the desired transmission. 
Further according to the Invention are basic apparatus for 
encoding and modulating as well as demodulating and 
decoding a signal In accordance with the Invention. Speclflcaiiy. 
a method Is provided for decoding that Incorporates a specific 
type of decoding/demodulation techniques which develops 
accurate estimates of the Information from the receded signal 
In a computationally efficient manner and which permits high 
speed operation using soft-decision decoders. 
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0 Method and apparatus for combining encoding and modulation. 



0 Signal sets are created from available amplitude 
and phase modulations by indexing ordered sub- 
spaces. The subspaces need not be limited to the 
class of subspaces known as binary subspaces. The 
resultant signal sets, for a preselected power and 
bandwidth, are widely separated and unlikely to be 
confused by the effects of channel noise. Such sig- 
nals can be in either finite block or convolutional 
form, depending on the natural formal of the desired 
transmission. Further according to the invention are 



basic apparatus for encoding and modulating as well 
as demodulating and decoding a signal in accor- 
dance with the invention. Specifically, a method is 
provided for decoding that incorporates a specific 
type of decoding/demodulation techniques which de- 
velops accurate estimates of the information from 
the received signal in a computationally efficient 
manner and which permits high speed operation 
using soft-decision decoders. 
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Description 

METHOD AND APPARATUS FOR COMBINING ENCODING AND MODULATION 



5 BACKGROUND OF THE INVENTION 

This invention relates to digital communications and more specifically to techniques for constructing 
bandwidth efficient signal sets by combining error correcting encoding with modulation of digital data. More 
specifically, the invention relates to generalized methods and apparatus for encoding and modulating digital 
information signals and methods and apparatus for demodulating and decoding signals from an Information 

10 channel containing information. The invention finds particular application to time-division multiple-access 
(TDMA) operation in a frequency-division multiple-access environment, such as a satellite transponder 
channel. 

In order to aid in identifying the relevance of the references cited herein, the references cited herein are 
referred to frequently by the abbreviations following the citations listed hereinbelow. 

15 In electronic data communication systems, random noise or interference can cause the transmitted signal to 
be contaminated and lead to errors in the received message. In systems where the reliability of received data is 
very important, error-correcting codes have been used to protect the transmitted message and enable system 
designers to reduce the effects of noise. Two major schools of thought and associated bodies of theory have 
emerged for performing this task: algebraic block coding, which relies heavily on the use of modern algebra 

20 and typically constructs codes as linear subspaces of a fixed size vector space over a finite field; and 
convolutional coding, in which the transmission is viewed as being continuous and the design typically relies 
more on computer search techniques and close analysis of the state diagram of the possible convolutional 
encoder circuits. 

For many years, the coding process was effectively separated from the problem of modulation in 
25 conventional systems. Modulation is the creation of, for example, electromagnetic signals in which changes in 
phase, frequency, or amplitude are used to distinguish different messages. 

Referring to Figure 1 representing a prior art system 10, in conventional systems 10 a block or stream of 
information digits 12 is fed into a digital encoder 14 designed for a specific error-correcting code where 
redundant check bits are added. The resultant encoded digits 16 are then fed into a modulator 18 where each 
30 digit or set of digits is typically mapped to a modulated symbol to be transmitted as information in for example 
a radio frequency signal 20. The radio frequency signal 20 Is applied to a channel 22 wherein noise and 
interference 24 are added and then received as a signal with errors 26 at a demodulator 28. The demodulator 
28 attempts to extract from the signal with errors 26 redundant digits with errors 30 which are fed to an error 
correcting decoder 32 designed to accommodate the error correcting code. The decoder 28 then uses known 
35 redundancy structure of in the encoded digits 16 to eliminate as many errors as possible producing as its 
output estimated received digits 34. In some systems, the demodulator 28 also provides "soft decision 
information" or "reliability* information along with the estimate of the received digits which can be used 
effectively In a variety of error-correcting decoders to improve performance, particularly Viterbi decoders for 
convolutional codes. 

40 To maintain the separations between different messages guaranteed by the minimum Hamming distance of 
the error-correcting code, the mapping performed by the demodulator 28 must be chosen with care. {The 
Hamming distance between two words is the number of digits in which the two words differ. The minimum 
Hamming distance of a code is the minimum over all pairs of code words in the code of the Hamming distance 
between the two code words.) For example, in binary systems using phase-shift modulations, the 

45 correspondence between the redundant binary sequences and the particular phase of a transmitted signal is 
often dictated by a Gray code. 

The use of error-correcting coding in this manner frequently Is an alternative to increasing the power of the 
transmitted signal to overcome the noise. Conversely, the use of coding permits the power of the transmission 
to be reduced with no degradation in the reliability of the transmission. The power savings obtained in this way 

50 are measured in terms of the allowable reduction in decibels of power-per-bit for the same bit error rate, a 
quantity referred to as "coding gain." However, since coding requires the addition of redundant digits, for a 
fixed modulation scheme the use of coding requires that symbols be sent at a faster rate, thereby increasing 
the frequency bandwidth occupied by the transmission. 
As the demand for communication links has increased, there has been growing competition for the available 

55 electromagnetic spectrum, and significant expansion of the bandwidth of the signal to reduce the power 
required has no longer been acceptable in many instances. Thus attention has turned to methods of 
combining coding and modulation into one coordinated mapping to achieve signals that are efficient in both 
power and bandwidth utilization. In the past, efforts have followed the two pathways set by error-correcting 
coding theory, with some building on the concepts of 9onvolutional codes whereas others start from the block 

60 code ideas. 

In the convolutional school, a major step forward was made by Ungerboeck as described in his paper 
"Channel Coding with Multilevel/Phase Signals' [ung). In which he pointed out that the Euclidean distance 
properties of the electromagnetic signal space could be incorporated into the design of a convolutional code 



2 



0 282 298 

encoder. Figure 2 Illustrates the basic structure for comparison with Rgure 1 . Using the trellis characterization 
of the encoder, i.e.. a trellis encoder 44. Information digijts 12 are mapped directly to modulated signals 20. so 
as to add redundancy only when the electromagnetic symbols are likely to be confused. The error-correcting 
encoder and modulator are combined into a single coder/modulator herein called the treliis encoder 44. The 
standard Viterbi algorithm for decoding convolutional codes can be readily adapted to a so-called Vlterbl trellis 5 
decoder 48 to decode the received symbols (signal with errors 26) directly to estimated infomiation digits 34. 
In adapting the convolutional coding methodology. Ungerboeck chose not to "pursue the block coding aspect 
because the richer structure and omission of block boundaries together vAth the availabllrty of Viterbi 
f^L-decoding algorithm [sic] make trellis codes appear to us more attractive for present coding problem 
(ung.p.58].* 10 

Others have followed Ungerboeck. For example, recently S. Q. Wilson has shown a construction tor rate 5/6 
trellis codes for an 8-state phase-shift keying (8-PSK) system and has found that tt achieves an asymptotic 
gain of 6.2 dB over an uncoded 8-PSK system [wlsn]. 

Other researchers have pursued the construction of efficient coding/modulation ^sterns from the algebraic 
block code point of view. Imai and Hirakawa showed how error-correcting codes of Increasing strengths can is 
be coupled to Increasingly error-senslttve parameters of the signal modulation In both multilevel and 
mutliphase modulations to give Improved performance. Furthermore they explained a staged decoding 
method in which the most sensitive parameters are estimated first* u^lng IhQ .^jQsterlort probabilities based 
on the channel statistics and the code structure wherein those estimates are used In later, probability 
calculations to determine estimates for the successively less sensitive parameters [l&h]. 20 

Simliariy, V. V. GInzburg has used algebraic techniques to design multilevel multiphase signals for a 
continuous channel. His methods address the case where the measure of distance in the continuous channel 
is monotonically related to an additive function of the distances between Indtvfdual signal components. (Such 
addltivity is commonly assumed in satellite channel models, for example.) He generalized the Ideas of Imai and 
Hirakawa by partitioning the set of elementary modulation signals into carefully chosen subsets that permit the 25 
actual channel distance between signals to be associated with the particular subsets In which the signals are 
found. He then combined a hierarchy of subsets with a matching hierarchy of codes of Increasing strength to 
design signal sets that are guaranteed to have large separations In the signal space. The algorithms he 
suggested for demodulating and decoding the signals has been given In only abstract mathematical terms: "A 
rigorous maximum-likelihood demodulation procedure of acceptable complexity may be built only In 30 
exceptional cases. A most simple approximate procedure implementing an energy distance D (i.e., one that 
leads to a correct decision for a noise energy < D/4) may be built as a sequence of Integral reception 
procedures (to be carried out In the order of decreasing levels) for the Individual codes that define the 
signal-system construction, If each of them Implements D [gnzj. 

Most recently. Sayegh [syh] has developed hjrther the methods of Imai and Hirakawa by explicitly defining 35 
particular block codes that can be attached to the various levels of a hierarchy which admits to soft- decision 
decoding procedures, and he has demonstrated some achievable gains using his methods through simulation 
studies for very short codes. Sayegh's work Is notable as well In that he has shown how Imai and HIrakawa's 
method can be combined with the signal set partitions of Ungerboeck to create combined coding and 
modulation systems based on several other signal constellations. Sayegh's work represents what Is believed 40 
to be the most relevant development to the present Invention. However. Sayegh does not represent a prior art 
publication, since publication was less than one year prior to the filing date of the present application. 

Other authors [ck&sl] [frny86] have approached the problems of constructing bandwidth efficient signal 
sets using mathematically defined lattices. Thus, their work Is distinguishable as essentially unrelated to the 
present scheme. 45 

Deficiencies In the Prior Art 

To understand the key advances of the present Invention. It is important to understand the deficiency of the 
conventional practice of decomposing the process of creating the radio wave signal Into separate processes 
of error-correcting encoding followed by modulation with, for example In the case of PSK, a Gray code; how 50 
the more recent methods ([l&h], [ung] and [gnz]) create a more effective linkage between the code structure 
and the demodulator and thus Improve the quality of the constructed signal set; and how the new methods of 
the present invention present significant advantages In the effectiveness of the linkage both for creating high 
quality signal sets and facilitating computation of the estimation of the transmitted Information by the receiver. 

The preponderance of the literature and theory on the constnjctlon of en-or-correcting codes addresses the 55 
problem of creating linear codes (e.g., [v&o. pp. 82-101]), which are well suited for protecting messages to be 
sent across a symmetric channel. For the symmetric channel, a central Index of the quality of a code Is its 
minimum Hamming distance, the minimum number of digits In which any two distinct code words must differ. 
The mathematical theory of codes such as BOH codes, which are output from an encoder to a modulator, 
attempts to guarantee that the minimum Hamming distance of the code In the (digital) vector space of the 60 
communication channel Is as large as possible for a given code rate and block length, since the larger the 
minimum distance, the more errors that are certain to be conrectable by a maximum likelihood decoding 
algorithm. 

However, on the continuous white Gaussian channel, most modulation schemes do not Induce a symmetric 
channel from the perspective of the digital en-or-correcting coding system. Certain pairs of elementary 65 
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modulations are closer In the Euclidean space of the channel than are others, and thus they are more likely to 
be confused than others. At very high signal-to-noise ratios, the probability of error for a maximum likelihood 
decoder is directly related to the minimum Euclidean distance separating any pair of distinct transmitted 
signals. Thus, for an entire coding/modulation system, an important measure is the minimum Euclidean 
5 distance. 

To illustrate by reference to Figure 3. in the case of phase-shift modulations such as 8-PSK in conventional 
systems, the use of a Gray code mapping of binary triples to phase states serves the purpose of assuring that 
the Hamming distance of the error-correcting code is reflected in a reasonable lower bound on the Euclidean 
distance. In Figure 3 for a specific example, since by definition of a Gray code, the Gray code binary sequences 
10 associated with any pair of adjacent modulations differ in exactly one bit, the minimum squared Euclidean 
distance of a pair of signals In a two-dimensional signal subspace formed by a binary error-correcting code of 
minimum Hamming distance D and Gray coding must be at least D 52, where 62 is the minimum squared 
Euclidean distance between modulation phases. 

This scheme is deficient because It creates a potential ambiguity due to the simultaneous occurrence of 
15 minimums. Specifically, the minimum Hamming distance separation in binary sequences can be achieved 
simultaneously with the minimum squared Euclidean distance of the modulation, thus creating a signal set for 
which a pair of signals Is separated by a squared Euclidean distance that is the product of minimums, D b^, 
which is the undesirable ambiguity. 

Both Ungerboeck and Ginzburg avoid the possibility of the simultaneous occurrence of minimums by 
20 coupling the coding to the modulation via a careful nested partitioning of the available modulations into 
subsets. In Ungerboeck*s language, the mapping of binary sequences to modulations "follows from 
successive partitioning of a channel-signal set into subsets with increasing minimum distances: 

Ao < Ai < A2 ... 

between the signals of these subsets." Ungerboeck then attaches modulations of particular subsets directly 
25 to edges in a trellis encoder for a convolutional code in such a way that the constraints of the trellis prevent the 
smallest Euclidean distances from occurring on all of the edges of the short paths originating and terminating 
at the zero state of the trellis. Effectively, this prevents a simultaneous occurrence of minimums in both the 
redundancy imposed by the trellis and the Euclidean separation of the modulation. 
Similarly, Ginzburg, in his hierarchical construction, defines partitions with L levels and associated minimum 
30 squared Euclidean distances satisfying: 
6l2 < ... < A22 < 6i2 

(adapting Ginzburg's language to the present notation). He then associates a different error-correcting code 
with each level, the code for the 1»h level having a minimum distance Di. (Note the difference between the 
variable 1 and the numeral 1 herein.) The squared Euclidean distance for the signals thus created must be at 
35 least: 

D ^ min (6^^^ ). 

40 

Since the Di values are chosen to be larger for the 61 that are smaller, this minimum is much greater than the 
product of the minima. Likewise, the eariier technique of Imai and Hirakawa may be viewed as a special 
instance of Glnzburg's signal construction method. 

45 In Ginzburg's method, the use of freely created nested partitions creates some limitations. At the 1*^ level, 
there are actually a very large number of partitions, a different partition for each of the subsets created in the 
partition at the (1-1 )»i partition. Due to the process of successive subdivision, the number of subsets of 
modulations that must be considered grows exponentially with the level, and the 61 associated with the 1*^ 
level Is actually a minimum over all of the subpartitions at the ^^ level. 

so VVith regard to prior art decoding circuitry and methods as hereinafter discussed, all of the workers in the 
field previously cited have recognized the difficulty of decoding these high performance coding modulation 
schemes. Typically systems in which combined coding and modulation is contemplated are those where soft 
decision information is available. The most commonly used algorithm is the Viterbi algorithm, which can 
incorporate soft decision information into the calculation of path metrics. The path metrics are used to 

55 determine the best estimate of each of the transmitted bits. 

There is nothing in principle that precludes the use of the Viterbi algorithm in cooperation with 
encoding/modulation systems with encoders according to the invention as described herein. If all such 
encoders are convolutional. the encoder can take the form of a trellis encoder and the resultant signal can be 
decoded using the techniques suggested by Ungerboeck for trellis codes. In practice, however, the powerful 

50 codes created by the encoders of the invention as described herein can create redundancies which interrelate 
a large number of transmitted symbols and. when viewed as trellis codes, have an extremely large number of 
states. The number of states will in most instance's make the Viterbi algorithm impractical. 

For the encoder/modulators based on block codes, the same problem is encountered. Most techniques for 
decoding block codes using soft decision Information are very complex. For example, the Chase algorithm 

55 [ch] can be employed when the expected number of errors Is very small, but the computational effort required 
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grows exponentially when the number of errors to be corrected Increases. Similarly, it is possible to 
contemplate the use of Forney's generalized minimum c|istance decoding [fmy66], but the complexity of this 
technique In practice is usually prohibitive. 

What is needed therefore Is very efficient low-compiexity algorithms. The present Inventor as described in 
Tanner (tanSIl has described algorithms which as described hereinbeiow have potential interest In 5 
decoding/demodulation methods and apparatus according to the Invention. The Tanner article Is therefore 
incorporated herein by reference and made a part hereof. Tanner's algorithms lead to a wide variety of decoder 
architectures, many of which are parlicularty well suited to parallel Implementation In large scale Integrated 
circuits. While the algorithms described In the Tanner article (e.g., Algorithm B) do not perform maximum 
likelihood decoding, they can be used effectively to decode much longer codes than can other methods, either io 
large length biocl< codes or large constraint length convoiutional codes, without Incurring prohibitive circuit 
complexity costs. Moreover, the sub-optimal Algorithm B. for example, can Incorporate soft decision 
information into the decoding process for either block or convoiutional codes with very little increase in the 
complexity of the decoding algorithm. In practice, decoding systems based on Tanner algorithms can 
outperform many Viterbl algorithm-based systems because the sub-optlmallty of the decoder performance Is 15 
minor compared to the advantage of using a more powerful coding/modulation design. 

In most advanced modulation systems, the demodulator receives a single symbol that can be viewed as a 
vector In some symbol vector space. It then computes a distance measurq for the. separation between the 
received symbol and all of the possible elementary modulations. In so-called "hard decision" demodulators, 
the distance measure is heavily quantized to two Implicit values. The closest elementary modulation is emitted 20 
as the best estimate (implicitly at distance 0) and the others are viewed as being at. distance 1. In 'soft 
decision* demodulators, the demodulator can put out numbers, typically viewed as quantized representations 
of real numbers, that indicate the likelihood that the received vector came from each of the possible 
elementary modulations. 

Making optimal use of this "soft decision" Information as well as the constraints imposed by the digital code 25 
structure is in general very difficult. While It Is possible to contemplate the design of a decoder based on 
Tanner's algorithms that would use all of the probability infomiation provided by the channel for a 
sophisticated modulation scheme, heretofore nothing has been taught or suggested which could optimize the 
process in a simple fashion. 

Imai and Hirakawa proposed a technique for pure 2M-ary PSK and pure multilevel signaling wherein the most 30 
sensitive or least significant bit of the modulation are decoded using calculated probabilities [l&h, p. 373]. The 
estimates for these least significant bits are then fed Into a decoder for the L-th error-correcting code, 
generally the most powerful code. The final decision btts from this decoder are then used In combination 
with the channel soft-decision Information in providing the probability estimates needed for the (L-1)»t 
decoder. The final decision bits fi-om the (L-1)»t stage along with the final decisions fi-om the L«h stage are In 35 
turn used In providing the probability estimates needed for the (L-2)nd decoder, and so forth, until the most 
significant bits are decoded. 

While the description is very incomplete. Sayegh's decoding procedures [syh. p. 1044] appear to be those of 
Imai and Hirakawa adapted to the additional modulations he treats, requiring an optimal decision at each stage 
of a sub-optimal procedure. This decomposition adds a further source of potential loss. If the decoder at some 40 
stage does not provide the correct final decision bits, the estimates used in calculating probabilities for all 
successive stages will reflect the errors and increase the possibility of decoding enror in those later stages. 
However, for high-speed systems the decomposition has the advantage of creating parallel data paths for the 
decoding of the bits of different significance. In the representative circuit shown In Figure 2 of Imai and 
Hirakawa, there are four different decoders for different error-correcting codes all working simultaneously in 45 
pipelined fashion. As a result, each of the decoders must handle data at only a fraction of the raw Input rate, in 
high performance systems, very efficient error-correcting codes must create dependencies that Interrelate 
large numbers of digits, requiring either a long block length in the case of algebraic block codes or a long 
constraint length In the case of convoiutional codes. As Is well known to those acquainted with the coding arts, 
decoding such codes using soft decision Information Is very complex. Typical Implementations for such '50 
decoders either cannot handle high data rates or require large and complex circuits that consume significant 
power. What is needed Is a more efficient decoding scheme. 

SUMMARY OF THE INVENTION 

According to the invention, method and apparatus provide combined encoding and modulation which 55 
creates signal sets from available amplitude and phase modulations by Indexing Into ordered subspaces. The 
ordered subspaces need not be limited to the class of subspaces knovm as binary subspaces. The resultant 
signal sets, for a preselected power and bandwidth, are widely separated and unlikely to be confused by the 
effects of channel noise. Such signals can be In either finite block or convoiutional fonn. depending on the 
natural format of the desired transmission. Further according to the invention are basic apparatus for encoding 60 
and modulating as well , as apparatus for demodulating and decoding a signal In accordance with a 
demodulation/decoding method of the Invention. Specifically, a demodulation/decoding method Is provided 
for Incorporating a known decoding technique that develops accurate estimates of the information from the 
received signal in a computationally efficient manner and that permits high speed operation using 
soft-decision decoders. ^ 
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The invention will be better understood by reference to the following detailed description in conjunction with 
the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
5 Figure 1 is a block diagram of a first prior art error correcting code-based communication system. 

Figure 2 is a block diagram of a second prior art error correcting code-based communication system. 
Figure 3 is a phase diagram (modulation constellation diagram) illustrating a Gray code indexing of 
phase states for 8 PSK modulation. 
Figure 4 is a phase diagram illustrating indexing of phase states for a set partitioning technique. 
^0 Figure 5 is a block diagram of a general encoder/modulator structure in accordance with the invention. 

Figure 6 is a constellation diagram illustrating indexing of an 8-AMPM signal in accordance with one 
embodiment of the encoder/modulation technique according to the invention. 

Figure 7 is a constellation diagram illustrating indexing of an 8-AMPNy| signal in accordance with a 
second embodiment of the encoder/modulation technique according to the invention. 
15 Figure 8 Is a phase diagram illustrating indexing of a 6-PSK signal in acccdance with a further 

embodiment of the encoder/modulator according to the invention. 

Figure 9 is a flow chart of a generalized decoding/demodulation method Implemented in a preferred 
embodiment of a demodulator/decoder implemented in accordance with the invention. 
Figure 10 Is a phase diagram Illustrating extraction and demodulation of a signal of a prior art decoding 
20 and demodulation method. 

Figure 11 is a phase diagram illustrating extraction and demodulation of a signal according to one 
embodiment of the present invention. 

Figure 12 is a phase diagram illustrating extraction and demodulation of a signal according to a further 
embodiment of the present Invention. 
25 Figure 13 Is a block diagram of an encoder/modulator structure in accordance with a preferred 

embodiment of the invention. 
Figure 14 is a block diagram of a demodulator/decoder in accordance with a preferred embodiment of 

the invention. 



30 DETAILED DESCRIPTION OF THE INVENTION 

According to the present invention, a method is provided for making the minimum Euclidean distance in the 
Euclidean space of a communication channel as large as possible, or, equivalently and more conveniently, to 
make the squared Euclidean distance as large as possible, rather than concentrating alone on the Hamming 
distance of the error-correcting code in the vector space of the digital channel. More specifically, modulations 

35 are indexed to form them into ordered subspaces. which Include both binary and nonbinary subspaces. The 
subspaces provide more highly disciplined indexing that could otherwise be exploited without further detailed 
knowledge of the structure of the particular modulations. 

Encoding and Modulation Methods and Circuits 

40 To create the tightest linkage between the structure of the digital error-correcting code and the modulation, 
the digital indexing of the possible modulations is crucial. Algebraic error-correcting codes are in almost all 
instances based upon finite fields and can be organized into subspaces. These subspaces are themselves 
error-correcting codes of potentially different correcting abilities. The well-known BCH codes, for example, 
can be viewed as nested, with a larger minimum distance code with more numerous roots being a subcode of 

45 a code with fewer roots and smaller minimum distance. For instance, the words of the (15,1 .15) BCH code are 
all words in the (15.5,7) code, which are In turn alt words in the (15.1 1 ,3) code, which are in turn all words in the 
trivial (15.15,1) code. It has been shown by others that such nested subcode structure could be used to 
construct recursively long and powerful error-correcting codes based on simple codes that form nested 

subspaces. ^ ^ * 

50 According to the present invention, however, the method of constructing nested subcodes from 
error-correcting coding theory is adapted to the construction of combined coding and modulation systems. 
The available modulations are indexed by vectors over a finite field in such a way that the additive modulation 
distances are well organized by subspaces and affine (shifted) varieties of those subspaces. 
To illustrate, with reference to Figure 4, consider the indexing of the 8 PSK modulations induced by set 
55 partitioning of the type taught by Ungerboeck. In accordance with the invention, a quanternary phase shift 
keying set with minimum squared Euclidean distance of 2 is formed by fixing the set of modulations formed by 
the last of the three bits at either 0 or at 1. Consequently any pair of modulations differing only by changes 
restricted to the two-dimensional subspace formed by the topmost, the most significant bit, and the center, 
the center significant bit. have a squared Euclidean distance separation of at least 2. Similar.y, If the two 
60 rightmost indexing bits, the center and the least significant bit. are fixed at any one of the four possible values, 
the pair of modulations differing only in the most significant bit have a squared Euclidean distance separation 
of 4. (In the case of 8 PSK, this Indexing of modulations is like that created by Imai and Hirakawa, using 

different notation.) ^ , ^. 

Figure 5 illustrates a basic encoder/modulator apparatus 100 according to the invention for exploiting the 
65 organization of the modulations described hereinabove. The encoder/modulator apparatus 100 comprises a 
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first, or Isb. encoder 102. a second, or csb. encoder 104, a third, or msb, encoder 106 and a digit-to-modulation 
mapping subsystem 108 coupled to receive, respectively, the most significant bit (msb), the center significant 
bit (csb), and the least significant bit (Isb) from Inputs of Information digits. The Isb encoder 106 is of the form 
which generates a strong binary error-correcting code with minimum Hamming distance D3. The Isb code is 
the strongest code and therefore has the most impact on decoding. A change In one Information bit going into 5 
the Isb encoder 106 causes a number of bits at least equal to the value D3 to be changed going into the 
mapping circuit (a conventional one-for-one table translation from a pure digit to a radial valu? signal, which In 
turn is applied to an analog signal modulator), which in turn leads to a squared Euclidean distance of at least 
532 D3, no matter what changes occur in the information bits going into Encoders 1 and 2. If no changes occur 
in the information bits going into Isb encoder 106, then any change in the information bits going into csb W 
encoder 104 must cause a number of bits equal to at least the value Da to be changed, which then leads to a 
squared Euclidean distance of at least 62^ D2. no matter what changes occur In the information bits going into 
msb encoder 102. Finally. If no changes occur in the Information fed Into Isb or csb encoders 106 or 104. any 
change in the information bits going into msb encoder 102 must cause at least Di bits to be changed, which 
leads to a squared Euclidean distance of at least 61^ Di. The minimum squared Euclidean distance separation IS 
of any pair of encoded modulations is thus at least: 



D ^ min ( 6 D^^ ) . 



20 



The method practiced by apparatus according to the Invention differs significantly from the methods of the 
prior art For example, unlike both Ungerboeck and Glnzburg, the modulations are organized by subspaces, 25 
rather than by the mathematically more general but practically less useful hierarchy of subsets. The subspaces 
create more highly disciplined Indexing that can be exploited without further detailed knowledge of the 
structure of the particular modulations. 

Similarly, while Imai and Hirakawa's construction lead to subspaces In the case of several particular types of 
modulations, the possibility of subspace organization was never recognized and thus no advantage has been 30 
suggested of the fiexibility afforded by subspace organization. 

Still further while Sayegh's constructions (which Include 8-AMPM and 16-QASK as well as PSK 
modulations) use the modulation indexings suggested by Ungerboeck. the Ungerboeck's labellings would 
Induce one of many possible sequences of nested binary subspaces for the modulations described therein, 
Sayegh failed to recognize or suggest that any equivalent subspace organization Is sufficient or that the 55 
subspaces need not be binary in general. 

To understand the flexibility of the subspace organization, suppose that any arbitrary modulation can be 
indexed by subspaces of bits such that changes restricted to si bits forming a Subspace 1 induce a squared 
Euclidean distance of at least 6i2 ; changes restricted to the si bits forming a Subspace 1 or the S2 bits fonning 
a Subspace 2 induce a squared Euclidean distance of at least 622; changes restricted to the si bits fqrming a 40 
Subspace 1 the S2 bits forming a Subspace 2. or the S3 bits forming a Subspace 3 Induce a squared Euclidean 
distance of at least 63^; and so forth. We assume 6i2> 622> 632> . . .> Sl^. Typically such subspace 
indexings of the modulations can be created by using the groups and subgroups of InvarlanceS of the set of 
elementary modulations. In general the subspaces need not be over extension fields of the binary field; fields 
of characteristic other than 2 may be appropriate for other signal constellations. Typically, however, extension 45 
fields of the binary field are of the greatest practical Importance, and we will focus attention primarily on such 

examples. , ^ .««x j 

To perform the combined encoding and modulation, a first error-con-ectlng encoder 102 for a code wnth 
minimum Hamming distance Di. producing symbols consisting of si bits. Is used to produce the successive 
sets of Si bits to be fed into the most significant subspace lines 103 of the digit-to-modulation mapping so 
subsystem 108. Similariy. a second error-con-ecting encoder 104 for a code with minimum Hamming distance 
D2 producing symbols consisting of S2 bits, is used to produce the successive sets of S2 bits to be fed into the 
next most (center) significant subspace lines 105 of the digit-to-moduiation mapping subsystem 108. This 
continues until at the bottom, an error-con-ecting encoder for a code with minimum Hamming distance Du, 
producing symbols consisting of sl bits. Is used to produce the successive sets of sl bits to be fed into the 55 
least significant subspace lines of the digit-to-modulatlon mapping subsystem 108. In practice, the \^ encoder 
may be either a convolutionai encoder or a block encoder for digits in an extension field GF(2»i). or, more 
simply. Sl copies of a binary error-correcting encoder for a code with minimum Hamming distance Di (although 
such copies are usually less efficient for the same level of protection). In cases where the Euclidean distance 
separations of the !«» subspace mirror perfectly the Hamming distance separations of the digital code (as Is the ^ 
case for QPSK modulations), the si digits for the \^ subspace may bo I successive digits from an 
error-correcting code word. 

With this subspace organization, by choosing the error-correcting codes to have minimum Hamming 
distances that very roughly Inversely with the squared Euclidean distance of subspaces, It Is possible to create 
combined coding/modulations vrith very large channel distance separations at relatively high coding rate and S5 
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without bandwidth expansion. Two examples of systems for more subtle modulations will serve to illustrate the 
signal creation method and distinguish the present invention from the more limited methods of Imai and 
Hirakawa and Sayegh. 

Figure 6 illustrates 8-AMPM modulation as two QPSK modulations 50 and 50' indexed as two subspaces 
5 which are combined with binary unit displacement 52. The resulting indexing 56 is illustrated in the adjacent 
portion of the figure. The X's correspond to the positions defined by the combined quadrature modulations. 
The corresponding index value is a three-digit binary number of an eye pattern. Figure 6 thus shows how 
8-AMPM modulation can be viewed as the combination of two "large grain" QPSK modulations each defined 
on respective two dimensional unit radius circles 50 and 50' shifted by a unit displacement 52 relative to each 
10 other. A "small grain* binary subspace determines which of the two QPSK versions circumscribed by the unit 
radius circles 50 or 50' is sent. If the QPSK signal is Indexed to be broken up into two subspaces, one with 
squared Euclidean distance of 2, e.g., between 1 1 1 and 100 (54) and the other with squared Euclidean distance 
4, e.g.. between 111 and 110 (56) as shown in the right side of Figure 6, these can be used as the most 
significant bits of a three bit Indexing of 8-AMPM. The least significant bit is the value of the binary unit 
15 displacement 52 and is the third bit (the left-most bit of each triplet in the Figure) which determines which of 
the two displaces QPSK versions 50 or 50' is sent. The result is a labeling identical to that of Ungerboeck as 
used by Sayegh. 

Figure 7 shows another indexing scheme according to the invention. Figure 7 illustrates 8-AMPM 
modulation as two Gray code signals constellations 60 and 60' indexed as two subspaces which are combined 

20 with binary unit displacement 62. The resulting indexing 66 is Illustrated In the adjacent portion of the figure. 
The X*s correspond to the positions defined by the combined quadrature modulations. The corresponding 
index value Is a three-digit binary number of an eye pattern. Figure 7 thus shows how 8-AMPM modulation can 
be viewed as large grain QPSK components indexed by a conventional Gray code to form two-dimensional 
subspaces In which the Hamming distance of a binary error correcting code is mirrored exactly by the squared 

25 Euclidean distance of the modulation combined by a binary unit of displacement. As before the choice of 
binary subspace (selected by binary unit displacement 62) determines which of the two versions 60 or 60' is 
transmitted. This indexing 66 is shown in Figure 7, and it is obviously not equivalent to Ungerboeck*s Indexing 
(equivalent to 56 of Figure 6). With this indexing 66. the two dimensional subspace 60 or 60' can be determined 
by two successive bits from a single binary error correcting code of minimum distance Di. The third subspace 

30 bit can determined by another binary error-correcting code of minimum distance D2. The squared Euclidean 
distance separation of any two signals created by the system is at least: 
D > min ( 2 Di, D2 )- 

Because longer error-correcting codes are more efficient than short ones for a given minimum distance, this 
construction in many Instances gives more efficient signal sets than does Sayegh's construction and Is 
35 therefore a notable advance. 

The method of construction according to the invention suggests other alternatives. For example, a 1 6-QASK 
can be viewed as the combination of a large grain QPSK with a smaller grain QPSK set of displacements. Each 
of the QPSK signals can be indexed either as two separate subspaces or as a single two-dimensional 
subspace. 

40 Further according to the invention, constructions based on nonbinary subspaces may also be implemented. 
With reference to Figure 8, such a possibility will be illustrated by an unusual modulation. 6-PSK. In Figure 
8 6-PSK is shown with an Indexing In which a single ternary digit from GF(3) (values 0,1 or 2) determines each 
3-PSK modulation 70 or 70' and a single binary digit selects which of two possible 3-PSK modulations 70 or 70' 
is used. This leads to a sequence of subspaces consisting of two subspaces: the first Is a GF(3) ternary 

45 subspace that selects a signal from a 3-PSK set and the second Is a GF(2) binary subspace that selects which 
of two rotated versions of the 3-PSK signal will be used. Using simple trigonometry and .assuming a unit radius 
circle, It can be determined that the squared Euclidean distance associated with the ternary subspace Is 3 
whereas that for the binary subspace is 1. Here the squared Euclidean distance separation of any two signals 
created by the system is at least 

50 D > min ( 3 Di, D2 )- , 
As a concrete Instance, the first ternary subspace code could be a ternary Hamming (121,116,3) code while 
the binary subspace could be (121,93,9) shortened BCH code. In 121 transmitted 6-PSK symbols 116(log2 3) 
-h 93 « 183.85 -H 93 " 276.85 bits could be transmitted (as opposed to 2(121) « 242 bits for QPSK) while 
achieving an asymptotic gain of logio(9/2) = 6.53 dB. over uncoded QPSK. 

55 The encoding structure described above provides a natural parallelism that Is convenient for high speed 
operation. However, using techniques considered state-of-the-art prior to the present invention, many of the 
signal sets created in this way could not be effectively decoded without the use of enormously complex 
decoding circuitry. A second advance of the present Invention Is to provide practical techniques for decoding 
the combined coding/modulation signal sets at high data rates and with very practical and cost-effective 

60 circuits. 

Decoding Circuits and Methods 

The present invention makes use of selected Tanner's algorithms as described In the 1981 Tanner article, 
the contents of which is incorporated herein by reference. In the present Invention, the decoding/demodula- 
65 tlon attempts to use all of the probability information provided by the channel for a sophisticated modulation 
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scheme in an extremely simple fashion. For high-speed pertormance. the preferred embodiment breaks the 
decorng p^cess Into Mages corresponding to the decoding of the digits by the same subspaces used In the 

'"Sf'workTSai and Hirakawa also serves as a point of departure for demodulation/decoding. In the 
oreTerrrd embodiment of the demodulator/decoder of the present Invention, the methods and circuits of .Ijnai 
Snd JJraklwa are Improved In three ways. First, decomposition Is organized by general subspaces In 
aJcorjancTwItS the Invention and implemented In the encoder/modulator of the present invention, rather than 
SfsSe birs as suggested for the limited set of modulations treated by Imal and Hirakawa- Subspace 
Si^ganization Lcording to the invention permits the methods of the present invention to be adapted to virtually 

'"LwJf ?L%'eTent invention, circuits suggested in Imal and Hirakawa are replaced by -extractors" 
which, at the i'" stage, produce quantized logarithms of the likelihoods: 

Prf S «= Si 1 R received), for each distinct index S|. ^ . 

where Sis the elementary modulation Indexed by s, In the 1"^ component: I.e.. the most Mkely e ementary 

^odltlonYs Indexed by s s,., st. Which are the best esHmates for the values of the digits of the mpre 

senste sub\pa^^^^ S ihe decoder In the previous decoding stages. In con.trast Jmal and hilrakawa 

usSd the S complex calculation of a posteriori probabilities with 'intemiedlate est ma ion circuits . 

?Wrd andTerSaps'most Importantly, one^rmore of the decoder circuits Is a decoder '^'e^" '"9 
the araoh-based decoding algorithms of the Tanner article ItanSI). In the preferred embodiment Algori hm B 
of the Tanner Side IS usld for the first time while supplied with quantized iogarith/ps of probability latlos by 
?he -eSr^? that stage. Hence, the Algorithm B Is employed with -softKleclslqn" lnformatK,n. 

Re?eS to the flow chart of Figure 9. Algorithm B Is as follows as adapted for decoding with soft decision 
infoSo? according to the present Invention. (The algorithm is described ,^th respect to.decoding based on 
hard decision Information on page 541 of the Tanner paper): . . ^ ui*i 

) Establish a Srmal Indexing f?r the registers requires (Step A) : Let R, be the register associated with bit 1. 

wherel - 1 2 .KhIchlsaclessedbyLbcodeprocessorl.where 1.2 S. R,(t) Is the value stored by 

The eaisterR after the t«« iteration, and R', Is a corresponding temporary storage register. Let V, where 
he register j;^^',^,^^ ^^^^j^g ^ ^gj^^g v,(^^ + 1 or -1 If the h». bit was received as a 1 (one) or 

a 0 (zero)' respectively. Let Ji be the Index set of the subcode processors accessing bit I. and let I, be the Index 

"2,^n^irtre^"g1sSr^r:ql^^^^^^^^^^ L V. registers with a v^ue.provlded by the corresponding 

ex?ac^ iasfd on?nf^^^^^^^^^^^ provided by the channel for the bit (Step B). Assign register R,(0) the value In 
reoister Vi{0) for each register Ri|. for which | Is an element of Ji (Step C). . . • 

3? Perfo m an iterative loop (Step 0) comprising a subcode phase (Step D1) and a bit register phase (Step 
D2) • in tSbcorphase (Step D1). f or each value t from 1 to f . where f Is a number of Iterations selected as a 
mane? ol engineering choice for accuracy and speed (the end of the loop is determined In Step D3). determine 
temporary value H\ as follows: 

R.. . = 1/21 max ( C . R.(t - 1) - Z^^it - 1) 
13 C c a 

( c • Rj(t - 1) + Bij(t - 1)1 



C^=+l 



- max 
C e a 
C.=-l 



for each i which Is a member of the set I,, where o is the set of vectors derived from all words In the J«.subcode. 

bv reolaclng each one In a code word with a + 1 and each zero In a code word wi h a -1 . 

C - (&S.!S each derived from a code word In the subcode by replacing each 1 1n the code word by a 

+1 and each 0 by a -1; 

Rj(t-1) Is the ordered vector of register values 

L?h il"u' -"f J memFer oJ the set L; and C«R| denotes a real vector Inner product. 

T/a IS idd and^-T. thin a!, R,, vies are dM'ded by m. the degree of bit nodes In the graph defining the 

^ttirbdvr^^sw 

3) Make a final decision for the value of the bit (Step E) : Using the J* subcode processor, find the vector for 
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C which achieves the maximum value for the real vector inner product of the last iteration in the ioop and store 
the corresponding component of the maximizing subcode word in the corresponding temporary storage 
register. That is, find: 

maxe caie •Ri(0]. where f is the floor function of (g-2)/4), and set R' hj •= Ci,, 
5 This will result in the output value of the ith bit being one if the sum of all B% where j Is a member of the set Jj. is 
greater than zero, and zero if otherwise. In other words, the final value of the iu> bit is determined by a majority 
vote of the best final estimates provided by the subcodes checking the \^ bit. (Note the difference between the 
index value 1 and the index variable 1.) Alternatively, the number of iterations may be preselected according to 
an engineering preference for precision and speed. A suitable number of iterations for a code of less than 
10 length 500 is three. 

A specific decoder implementing Algorithm B is described in connecting with Figure 13. Figure 13 Is 
described hereinbelow. 

The second distinction above will be more easily understood by considering the process of producing 
estimates for the values of the digits of the it^subspace starting from the most sensitive subspace in the 

15 simple case where each subspace is binary. For example, consider the 8-PSK modulation of Figure 4. 
Referring now to Figure 10. using Imai and Hirakawa's method, if vector R is received, to calculate the a 
posteriori probabilities Pr(S3 = 0I R received) and Pr(s3«1! R received), (1 R received means "given R is 
received* ) all of the eight distances 81-88 from R to each of the elementary 'modulations 
010,001.111.000.100.011,101,110 shown in Figure 10 must be used. 

20 In the extraction method according to the present invention. (Figure 11) only the two elementary distances. 
81, with modulation S3»0. and distance 82. with modulation S3»1. are used, assuming that the channel noise 
density function is a monotonically decreasing function of distance. If the channel noise density function is a 
monotonically decreasing function of distance, as is the case for white Gaussian noise, the two indicated 
distances 81 and 82 will be the shortest distances to the two most likely elementary modulations 53 = 0 and 

25 S3 = 1 , respectively. For relatively high signal-to-noise ratios, the a posteriori probabilities associated with the 
distances 81 and 82 are dominant in the calculation of the true a posteriori probabilities, and the probability 
calculation is greatly simplified by the use of these two alone. 

Consider an example with reference to Figure 12 and Figure 14 of 8 PSK modulations. (The full structure of a 
demodulator/decoder is described hereinafter). The decoder (306) for the least significant bit is operative to 

30 decide that for example the best estimate for S3, S3, is 0. An extractor (Figure 14 314) according to the present 
invention at the next stage Is operative to calculate the logarithm of the likelihood ratio of only the two most 
likely elementary modulations. (Imai and Hirakawa transpose most significant bit and least significant bit 
designations. In Imai and Hirakawa's rnethod. at the next stage the probability computation would have to use 
the probabilities associated with four distances, rather than only two distances 91 and 92.) The extractor may 

35 be specific for the type of noise expected in the channel. For this purpose, the extractor may be a simple 
read-only memory circuit which produces a defined precomputed output in response to an input based on a 
limited number of possible inputs. The results are used as the soft decision information for a decoder (Figure 
14, 308) which produces a best estimate for S2 « S2. In the case of 8 PSK modulations, the estimates sa and S3 
are used by the third extractor (320) that provides log-likelihood ratios for the decoder (324) determining the 

40 best estimate for si, si. Since S2 and S3 are specified (for example S2 = 1 and S3=0). there are only two 
elementary modulations possible si = 0 and si « 1, as shown in Figure 12, so the Third extractor (320) for the 
last stage is operative to calculate the same log-likelihood ratio as would Imai and Hirakawa's circuit, except 
much more efficiently. 

It can be appreciated that for complicated multilevel and multiphase modulations, the use of only the most 
45 likely elementary modulations represents a substantial simplification of the calculation required by the known 
prior art. 

The third advance is the use of decoders based on specific algorithms, and most specifically Tanner*s 
Algorithm B above. In the preferred embodiment, the most powerful error-correcting code is applied to the 
digits governing the most sensitive index subspace of the modulation. The graph-based algorithms of Tanner, 

50 particularly Algorithm B perform decoding as multiple iterations of replicated simple primitive operations that 
can be performed in parallel. As a result they can be implemented in large scale Integrated circuits which can 
handle extraordinarily high data rates and decode highly efficient codes with soft decision Information using a 
relatively small number of Integrated circuits. This property makes the algorithms an excellent choice for the 
error-correcting decoders of the present invention, particularly for the most powerful error-correcting code in 

55 high performance systems. . 

Figure 13 illustrates a preferred embodiment of an encoder/modulator 200 according to the present 
invention for the particular case of 8 PSK modulation on a white Gaussian noise channel at an operating 
signal-to-noise ratio E5/N0 of approximately 13.5 dB (output bit error rate of approximately 5 x 10-^) (compare 
Figure 5). Figure 14 illustrates a preferred embodiment of a demodulator/decoder 300 according to the 

60 present invention for the same type of encoding and modulation. While the encoder/modulator and 
demodulator/decoder shown here are compatible, there is nothing that precludes the use of an 
encoder/modulator of a different design with the demodulator/decoder of the invention or the use of a 
demodulator/decoder of a different kind with an encoder/modulator according to the invention so long as the 
signal Information is in a recognized modulation format. 

65 Referring to Figure 13, the strongest code, for the least significant bit or third Incremental subspace of the 8 
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PSK indoxina is a length 73 perfect difference set code wtlh 45 Information bits and minimum distance 10 
HMinrd 7*3 bv ySu^nl ^ check matrix with 10,ones per column and 10 ones per row. The code Is 
sSirtenedbyonXto 72^^^^^^^^^ 

sScanI b» is a [72 6i 4 shortened Hamming code fomied by using 72 of the weight three columns of the 
X check r^^^^^^^^^ 511 Hamming code as the parity check matrix (encoder 204)^e code for the 

Si^n fic^t S I a trivial (7272.1) code; that is. the infon.at.on Is uncoded ^-^STereln's PSK 
has the form shown in Figure 5 and is coupled to a diglt-to-modulation mapping subsystem 108 wherein 8-PSK 
moduTaSs aS^^^ in'ormation channel in the conventional manner. (If the order ot bit sign|f.cance Is 
reversed, the form of the encoder Is readily compared with the ordering of subspaces and presentation of Imai 

^"the stSre of the demodulator/decoder system 300 according to the invention Is shown in Figure 14. The 
Input is a signal represented by the time-related function rto. which Is an analog Input slgna^ or an equivalent 
digital signal representative of the Infomiatlon and noise In the communication channel ('o; e^jample a 
sampled data stream of discrete digital values which have a one-for-one correspondence with the analog 
SdomaS signal at the terminal of the communication channel). The demodulator/decoder subsystem 300 
roduceTas an output the estimated dlgHal subspace vector values s,.u., S2<u. and S3(ui. which represent the 
distinct si values delayed by 'd' time units. Specific time delays are as follows: t, - t-d,: tz - t, -dz. 
f - t2 --d3 - t . d; where d. represents the delay of decoding In accordance with the order ot processing for 
a rece ved vector. Several extraction circuits are employed which are operative to calculate log-llkellhood 
va ues as described hereinabove or as elsewhere hn the art (for example. In Imal and H IrakawaK 

The demodulator/decoder subsystem 300 comprises a first Intermediate extraction circuit Ei 302 coupled 
to)e«K/e an analog signal or equivalent bit stream r... and to apply a first extracted output s^nal 304 to a first 
iorithm-sSecinc decoder D, 306. A second algorithm-specific decoder 308 Is ^so provided. The flrst and 
secondTlg^rl1hm.specific decoders 306 and 308 Implement the Tanner Algorithm B (Figure 9) and co^lse a 
plurality of fixed registers and working registers (not shown) as needed to execute he «'90ri hm^The 
alqorlthm may be Implemented in connection with a digital computer processing system of a standard design 
or of a design especially suited to digital signal processing applications. One application has been descnbed In 
the Chethik et al. paper incorporated herein by reference. 

The output of the first algorithm-specific decoder Is a binary digital value s,(..l coupled to a first time buffer 
310 the output of which Is a binary digital value s,(..i supplied to a second time buffer 312. the output of which 
is the desired estimate value of si for the time slot or frame ts. .^,„„,,„„ 

The output of the first algorithm-specific decoder 306 Is also coupled to a second Intermed ate extraction 
circuit 314 to which Is also coupled an analog or equivalent Input signal ri.o. which Is the Input signal r delayed 
by d, time unit via afirst input time buffer b, 316. The second Intermediate extraction circuit Ez 314 processes 
Se deTyed signal or equiSalent bit stream ri... in view of the estimate s,(... and applies a result nonblnar^ 
orm to the second algorithm-specific decoder Dj 308. The output of the second algorKhm-speciflo decoder 
D, 308 is the estimate sal..), which in turn is coupled to be applied to a third time buffer B3 318 and to a thi d 
iniermediaVe extraction-circuit E3 320. The output of the third time bu/fer B3 318 is the desired output estimate 

-^'•nie output of the second algorithm-specific decoder 308 and the output of the first algorithm-spectflc 
decoder 306 are also coupled to the third Intermediate extraction circuit 314 to which °°"P'«^^,^ 
or equivalent (delayed) Input signal rt..). which is the Input signal r delayed by d, + djflme units >Ja he firet 
lnpu?tlme buffer b, 316 and a second input time buffer bz 322. The third Intemiediate extrac ion circuit E3 320 
processes the delayed signal or equivalent bit stream r<u. In view of the estimates s,i..) and sjiw and applies the 
?eLlUn nonbin^^^^^^ to a hard decision decoder H 324 for the most significant bit. The output of the hard 
decision decoder H 324 is the desired output estimate S3IW. ■ . « . hi, /n 

The decoder system 300 operates as follows: The Algorithm B decoder 300 for the least signmcant bit (D, 
30?ioSsfxede^^^ 

Xv-ded t^y he extractor (Ei 302). each log-llkellhood represented by a 6-bMuanttty 'n th« ex^^^^ 
impLentation. The two-phase correction process of Algorithm B (according to the flow chart of Figure 9 Is 
rToeaTed to example three times betore a best estimate tor each bit is produced. The best estimates are f ed 
^the ext?actj; f^r the next stage. The quantized log-llkellhood values provided by the extractor for the 
second stage are fed into the second Algorithm B decoder Dj 308 or the shortened Hf^";'"9 code- The 
decoder 3oS is structured on a graph for the code In which every bit Is checked °''a<^'y «hr«o of the nl^^^ 
parities. The resultant two estimates produced s, and sz are fed to the third ^*^°\^^^^^JZ!^^J^xhl 
significant bit stage. At this operating point, no coding is required on the mos «'9"^ J b't Inasmuc^ as the 
probability of error of binaiy PSK Is lower than the error rate for the estimates produced t>y the (72 44.10) 
decoder. Consequently, the extractor 320 output is hard limited by the hard declsbn decoder 324 P~d"ce a 
hard decision for the most significant bit. The output of the hard decision decoder H 324 l*th"s the desired 
output estimate saiw. which together with the other values si and sj represent the best estimate of the 
Information transmitted from the remote data source. ^, ^ 

S Zron studies of this particular preferred embodiment have been conducted. The system achieved 
beSal, S dB Of coding galn^ver uncoded 

an uncoded bit error rate of 5 x 10-^ The overall coding rate for the system was 

(44 + 63 + 72)/(3x72) - 82.80/0. This compares very favorably with any other system proposed or 65 
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implemented. At the finite bit error rate operating point of the present system and with actual implementation 
losses, a trellis code will achieve less than its asymptotic gain. 

The preferred implementation discussed is only illustrative of the many forms that combined coding and 
modulation systems realizing the advances of the present invention can assume. For example. It should be 
5 understood that the application of the invention to non-binary subspaces includes multidimensional 
subspaces and the term binary subspace as used herein applies to one-dimensional binary subspaces. It is 
therefore not intended that this invention be limited except as Indicated by the appended claims. 



10 

Claims 

1. In a digital signal communication system for communicating Information through an information 
channel, a method for combined coding and modulation of digital Information comprising the steps of: 
15 indexing digital signals representative of elementary modulations by Indexing vectors to create a 

decomposition of indexing vectors of an index vector space into a plurality of ordered subspaces, 
including binary and nonbinary subspaces; 

associating with each said indexing vector a Euclidean distance in modulation space such that any 
two modulations whose indexing vectors differ only by a distance vector contained in a'first subspace and 
20 any preceding (higher significant) subspaces of the series of ordered subspaces are separated in said 

modulation space by at least said Euclidean distance; and 

encoding information signals by encoders employing error-correcting codes, each said encoder 
producing a symbol representative of an indexing vector of the same dimension as a corresponding one 
of said ordered subspaces for communication of said symbol through said information channel. 
25 2, A method according to claim 1 wherein said error-porrecting codes are finite length block codes. 

3. A method according to claim 1 or 2 wherein said error-correcting codes are continuous overlapping 
convolutlonal codes. 

4. A method of encoding the modulated signals according to claim 1, 2 or 3 wherein said encoders 
encode concurrently to produce redundant indexing vectors, further Including the step of providing said 

30 redundant indexing vectors to a modulator mapping subsystem concurrently along parallel data paths. 

5. In a digital signal communication system for communicating information through an information 
channel, an apparatus for combined coding and modulation of digital information comprising: 

means for indexing digital signals representative of elementary modulations by indexing vectors to 
create a decomposition of indexing vectors of an index vector space Into a plurality of ordered 
35 subspaces, including binary and nonbinary subspaces; 

means coupled to said indexing means for associating with each said indexing vector a Euclidean 
distance in modulation space such that any two modulations whose Indexing vectors differ only by a 
distance vector contained in a first subspace and any preceding (higher significant) subspaces of the 
series of ordered subspaces are separated in said modulation space by at least said Euclidean distance; 
40 and 

encoding means coupled to said associating means employing error-correcting codes, each said 
encoding means for producing a symbol representative of an indexing vector of the same dimension as a 
corresponding one of said ordered subspaces for communication of said symbol through said 
information channel. 

45 6. An apparatus according to claim 5 wherein said error-correcting codes are finite length block codes. 

7. An apparatus according to claim 5 or 6 wherein said error-correcting codes are continuous 
overlapping convolutlonal codes. 

8. An apparatus according to Claim 5, 6 or 7 wherein said encoding means encode concurrently to 
produce redundant Indexing vectors and further Including a modulator mapping subsystem coupled to 

50 said encoding means, said modulator mapping subsystem for receiving said redundant indexing vectors 

concurrently along parallel data paths. 

9. An apparatus for encoding and modulating digital information to be transmitted as a signal in an 
information channel comprising: 

a first encoder; 
55 at least a second encoder; and 

a digit-to-modulation mapping subsystem coupled to receive encoded information digits from 
respective outputs of said first encoder and said at least second encoder; 

wherein said first encoder generates a strong error-correcting code from a set of possible codes 
t including nonbinary code, with minimum Hamming distance between encoded informatlcn digits such 

60 that a change in one information digits applied to said first encoder causes a number of digits at least 

equal to the value of said minimum Hamming distance to be changed for application to said mapping 
subsystem, with a squared Euclidean distance of ^t least D. where & Is the Euclidean distance and D 
is the Hamming distance, independent of any changes which occur In the Information digits applied to 
said at least second encoder. 

65 10. A combined decoding/demodulation apparatus for recovering digital Information In the form of 
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indexing vectors in ordered subspaces from an information channel comprising: 

means for receiving noise and modulations through the infomnatlon channel, said receiving means 

being suited to reception of modulations introducbd into said infomiation channel including more than 

pure phase shift keying and pure multilevel signaling; 

means coupled to said receiving means for estimating transmitted information from the received 5 

signal, said estimating means including successive stages of circuitry for extracting information 

pertaining to probability for a value of an Indexing vector of a last subspace in a series of ordered 

subspaces not yet estimated as a function of estimated values of indexing vectors in all previously 

decoded subspaces; and 

means coupled to said estimating means for decoding the value of said modulations as an indexing w 
vector value for an error-correcting code associated with each successive subspace thereby to produce 
estimates for each indexing vector through a last indexing vector of a last subspace. 

11. An apparatus according to claim 10 wherein at least one of said decoding means includes means for 
computing a plurality of subcodes and means for selecting from said plurality of subcodes a best estimate 

of a digit value for a received modulation. 15 

12. An apparatus according to claim 11 wherein one of the decoding means comprises a Tanner 
Algorithm B decoder employing soft decision information. 

13. An apparatus according to claim 10, 11 or 12 wherein said extraction means comprises means for 
producing decoder input information as a function only of a posteriori probabilities for each most likely 
elementary modulation indexed by each possible Indexing vector for its associated subspace in order and 20 
also indexed by estimated vectors produced by the decoders for each preceding ordered subspace. 

14. In a digital signal communication system for communicating Infomiation through an information 
channel, a method for combined decoding/demodulation to recover digital information In the form of 
indexing vectors in ordered subspaces from said information channel, said method comprising the steps 

of: 25 
receiving noise and modulation through said Information channel, said modulations introduced into 

said information channel including more than pure phase shift keying and pure multilevel signaling: 

estimating transmitted information from the received signal in successive stages for extracting 

information pertaining to probability for a value of the indexing vector of a last subspace In a series of said 

ordered subspaces not yet estimated as a function of estimated values of the indexing vectors in all 30 

previously decoded subspaces ; and 

decoding said modulation value as an indexing vector value for an error-correcting code associated 

with each successive subspace thereby to produce estimates for each Indexing vector through, a last 

indexing vector of a last subspace. 

15. A method according to claim 14 further including the step of computing a plurality of subcodes and 35 
selecting from said plurality of subcodes a best estimate of a digit value. 

16. A method according to claim 15. wherein the decoding step includes applying a Tanner Algorithm B 
decoding method with soft decision information to at least one said indexing vector estimate. 

17. A method according to claim 14, 15 or 16. wherein said extraction step Includes producing decoder 
input information which is a function only of a posteriori probabilities for each most likely elementary 40 
modulation indexed by each possible indexing vector for its associated ordered subspace and also 
indexed by estimated vectors produced by the decoders for each preceding ordered subspace. 

18. In a digital signal communication system for communicating information through an information 
channel, a method for combined decoding/demodulation to recover digital information in the form of 
indexing vectors in ordered subspaces from said information channel, said method comprising the steps 4S 
of: 

receiving noise and modulations through said information channel, said modulations Introduced into 
said information channel; 

estimating transmitted information from the received signal in successive stages and producing 
decoder input information which is a function only of a posteriori probabilrties for each most likely . 50 
elementary modulation indexed by each possible indexing vector for Its associated ordered subspace 
and also indexed by estimated vectors produced by the decoders for each preceding ordered subspace 
for extracting information pertaining to probability for a value of the Indexing vector of a last subspace In a 
series of said ordered subspaces not yet estimated as a function of estimated values of the Indexing 
vectors in all previously decoded subspaces ; and 55 

decoding said modulation value as an indexing vector value for an enror-correcting code associated 
with each successive subspace wherein the decoding step Includes applying a Tanner Algorithm B 
decoding method with soft decision information to at least one said indexing vector estimate thereby to 
produce estimates for each indexing vector through a last indexing vector of a last subspace. 

60 
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